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Abstract 

In this paper, a fourth moment bound for partial sums of functional of strongly ergodic 
Markov chain is established. This type of inequality plays an important role in the study 
of empirical process invariance principle. This one is specially adapted to the technique of 
f— ^ Dehling, Durieu and Volny (2008). The same moment bound can be proved for dynamical 

00 I system whose transfer operator has some spectral properties. Examples of applications 

ON ' are given. 
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r^J ■ 1 Introduction 

Fourth moment bounds for partial sums of stationary processes are a key tool in the study of 
functional limit theorems. In particular, it is the case in the investigation of empirical process 
invariance principle. It will be our main application. Let (JQ)j>o be a stationary process in 
M and F(t) = P(Xq < t). The empirical process associated to (Xj)j>o is defined by 



_. n— 1 

y »( t ) = 7^E^(-<»,t]TO-n*)}. t eR. (l) 



i=0 

One says that (Y n ) n >o satisfies an invariance principle if it converges in distribution to a 
mean-zero Gaussian process. In general, proofs of invariance principle consist of two parts: 
multivariate central limit theorem and tightness. Since the work of Donsker [8] for i.i.d. 
sequences and the work of Billingsley [2] for some weakly dependent processes, the chaining 
technique seems to be a suitable way to get the tightness of the process {Yn)n>o- Fourth 
moment inequalities are a central point in this technique. In many cases (like i.i.d. case), if 
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an inequality of the type 



E 



n-1 



"£{1^X0 - (F(t) - F(s))} 



i=0 



i 



< C(n(t-s)+n 2 (t-s) 2 ), (2) 



for all s < t is established then the tightness of the process follows. The difficulty is to deal 
with the sequence of indicator variables (l( st ](Xj))j>o. When the process (Xj)j>o has some 
mixing properties, like strong, uniform or beta mixing, (Xj))j>o inherits comparable 

properties and fourth moment bound can be established assuming some regularity conditions 
on Xq's distribution function (for an overview of this theory, see Dehling and Philipp [7J 
and references therein). In 2004, Collet, Martinez and Schmitt [I] proved a fourth moment 
inequality for expanding maps of the interval (see also Dedecker and Prieur [5]). They use 
spectral properties of the transfer operator associated on the space of bounded variation 
functions and the fact that indicators belong to this space. In other cases, some type of 
Markov chains and dynamical system (see Hennion and Herve [IT] , Gouezel [10] ) , one can have 
good properties of the Markov operator or the transfer operator on other spaces of functions 
which do not contain the indicator functions. In Dehling, Durieu and Volny [6], a new 
technique for proving empirical process invariance principle is developed using approximations 
of indicators by regular functions. The fourth moment bound of Corollary [2] is well adapted to 
this situation. The main point is that the Banach norm only appears through its logarithm. 
In Section [2] and Section [3] the fourth moment inequality is stated and proved for strongly 
ergodic Markov chain. In Section [U we state the same moment bound for a class of dynamical 
systems. Section [5] is devoted to examples of applications. 

2 Fourth moment inequality for Markov chains 

Let (X n ) n>Q be a homogeneous Markov chain with a stationary measure v. Denote by P 
the associated Markov operator and E the state space. Consider a Banach space (£>, ||.||) of 
^-measurable functions from E to R, which contains the function 1 = He- We will assume 
that the chain is ^-geometrically ergodic. 

Definition. The Markov chain (X n ) n>0 is B -geometrically ergodic or strongly ergodic (with 
respect to B) if 

a) there exist k > and < 6 < 1 such that for all f £ B, 

\\P n f-Uf\\<K6 n ll/H (3) 

where Uf = E„(/)1. 

b) there exists p > 1 such that (B, ||.||) is continuously included in (L p (v) , ||.[| p ). 
i.e. 3C > such that V/ G B, 

II/IIp<C||/|| (4) 

where \\f\\ P ={J\f\ p dv)*. 

Further, we assume that there exists a constant M > such that V/ € B and Vn e N, 

||/P n /||<M||/||||P"/||. (5) 
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In particular, this is the case if {B, ||.||) is a Banach algebra. In the sequel, with no loss of 
generality, we assume M = 1. 

Strong ergodicity covers a large class of examples (discussed in Section 5). It corresponds 
to the fact that the Markov transition operator acting on B has 1 as simple eigenvalue and 
the rest of the spectrum is included in a closed ball of radius strictly smaller than 1. 

For a function p : E — ► R, we consider the partial sum 



The aim is to get a fourth moment inequality for this partial sum when the function ip 
belongs to the space B. Our main results are the following. 

Theorem 1. If (A n ) n>0 is a B- geometrically ergodic Markov chain with stationary measure 
v, then for all ip G B such that E„ (ip) = and ip G h 4 (u) n L 39 (y), 



where — | — = 1 and K is a constant, 
v Q 

As consequence, the following corollary give a simplest inequality is the case where the 
function p is bounded. 

Corollary 2. If (A n ) n>0 is a B- geometrically ergodic Markov chain with stationary measure 
v, then for all <p G B such that K u {ip) = 0, ip is bounded and m^ = max{l,sup x | </?(#) |}, 



Assume that one can prove a multivariate central limit theorem for functions in B, then 
by the technique of Dehling, Durieu and Volny >6] , if the space B contains a class of functions 
approximating the indicators, an empirical process invariance principle follows. 

To be complete, we state the following result, which is a corollary of Gordin's Theorem 
[9j and from which we can deduce a multivariate central limit theorem. 

Proposition 3. If (A n ) n >o is ergodic and B -geometrically ergodic with p > 2 in Q), then 
for all ip G B, Sn ^^ vi f) converges in distribution to a centred normal law. 

See Hennion and Herve [11], Thm.IX.2, for sufficient conditions on B to have: strong 
ergodicity implies ergodicity. 



■n 



Sn {p) = ^ip (Xi) . 



K u S n {ip) 

<if [nll^Xo^lMog^HI+l) 

+n (\\<p (A ) 3 || 9 + \\ip (X ) 2 \\ q + \\p (A ) ||, + \\ip (A ) ||j) log 2 (|M| + 1) 




E„ S n {ipf < Am 3 [n\\p (A ) ||, log 3 (||(^|| + 1) + n 2 y (A ) f q log 2 (||(^|| + 1)] . 
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3 Proof of Theorem [T] 



Let us consider the assumptions of Theorem [T] hold. In the sequel, all the expectations are 
considered with respect to the measure v and Ti denotes the cr-algebra generated by Xj. 

Let ip E B with E (p) = 0. As the Markov chain is a stationary process, we have the 
following bound: 



E 



i,j,k>0: 
i+j+k<n 

which can be decomposed in three sums. 



E 



S n (<P>f 



< 4!n 



E E & ( X o) <P W <p (X l+j ) p (X i+j+k )) 

i=l j,k<i 
n 

+ E E fa (*°) v to ^ to*) v TOb+*)) 

i=i j,fc<j 

n 

+ E E E fa ^ to ^ ^ TOh7+*)) 

fc=l i,j<k 



(6) 
(7) 
(8) 



So to study the terms E (</p (Xo) 99 (Xj) ip (Xi+j) ip (Xi+j+ k )), we will consider three cases 
according to the greatest integer between i,j and k. 



Before, we can see that in all cases, by Holder inequality, we have 

|E {ip (X ) p (X) p> (X i+j ) cp (X t+j+k ))\ < \\<p (X ) \\j < \\<p (Xo) 4 
Further, let uq be a positive integer such that 

io g (|M| + i) MM + i) , 1 

< «o < ; - 1- 1- 



(9) 



logfl 



log# 



Note that 6 n °\\p\\ < 1. 
First case: i,j < A;. 

Here, we use the properties of the Markov operator P on the space B to get another 
majoration. Applying successively Holder inequality, properties (jl]) and ([3]), we get 

|E (ip (X ) ip {Xi) ip (X i+j ) p (X i+j+k )) I 

= |E (ip (X ) ip (X) ip (X^) (E (ip (X i+ j+ k ) \Ti+j) -E(ip (X i+ j+ k )))) I 
< \\ip (X ) ip (Xi) p (X^) \\ q \\P k ip (X ) - Hip (X ) || p 



< ||^(Xo)||| g C||PV-n^|| 

< ||</>(X ) 3 || ? C*«#||^||. 



(10) 
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Now, for sum ([8]), using ([9]) for the uq — 1 first terms and (j 1Q|) for the others, we obtain 

n 

fe=l i,j<k 

no — 1 n 

< ]T fc 2 |MX ) 4 || 1+ E fc 2 C7^(X ) 3 M fc |MI 

fc=l k=no 

n 

< (n - lfy (X ) 4 \U + C K \\<p (X ) 3 \\ q k 2 6 k - n «. 

k=riQ 

There exists a constant C\ which only depends on 0, such that 

n 

J2 k 2 & k-n < ^ (k + n - 2) 2 0*" 2 

fc=no fc>2 

< ^ k 2 6 k ~ 2 + 2(n - 2) 2 £#~ 2 + (n - 2) 2 £ # fc - 2 fc 

fc>2 fc>2 fc>2 

< Ci(no-l) 2 , 

because the three series converge. 

Thus, writing C 2 = — ^p, we get ra - 1 < C 2 log(||</?|| + 1) and 

n 

fc=l i,j<k 

< ci\\<p pf ) 4 lli iog 3 (IMI + 1) + c 3 |k TO 3 ll g iog 2 (IMI + 1), (ii) 

where C 3 = CndCl 
Second case: i,k < j. 

We can decompose the expectation as follows, 
|E (if (X ) v (Xi) v (X i+j ) y> (X i+j+k )) | 

< |E (<p (X ) v (X,) (E (ip (X l+j ) E {<p (X l+]+k ) - E (<p (X ) <p (X k )))) \ 

+|E (<p (X ) ip (Xi)) E ^ (X ) if (X k )) |. (12) 

In the right hand side, let us call Iij t k t ne fi rs t term and IIi <k the second one. 
Since E (<pP k <p (X )) =E((p (X ) E (99 (X fc ) |JF )) = E (<p (X ) <p (X k j), we have 

iij,k < ||^(Xo)^(X)l| g ||^(^V)TO-n(v9PV)(^o)l| P 

< \\<p(X )\\LC\\P*(<pP k <p)-IL(<pP k <p 



\2q 

< C||^(Xo) 2 || g ^'||^P fc 
and by assumption ©, 



yp^\\<M\\p^\\<^ 



Therefore, 

h,j, k < CK z y{x Q f\\ q 63 

< CK 2 y{x Q f\\ q vy\\ 2 . 

Now, thanks to the decomposition (fT2|) (using also inequality ©), for n big enough, 

n 

E E E ^ (^) ^ (^i+i+fc)) 

J=l i,k<j 

2no — 2 n 

< E i 2 ||^(x ) 4 ||i+ E E( J ^ + /I ^) 

j=l j=2no—li,k<j 

n n 

<8(n -l) 3 |MX ) 4 ||i+ E iV + EE%- 

j'=2no — 1 j=l *>fc^i 

where no has been defined previously. 
Inequality flUD and 6> n °||v9|| < 1 imply 

n n 

E ^' 2/ m> ^ E i^lK^ofMi^f 

j=2no— 1 j=2no—l 

n 

< CK 2 y(x ) 2 \\ q E j 2 ^'~ 2no - 

j=2no-l 

As before, there exists a constant C4 depending on such that, 

rt 

E i 2 ^~ 2no <C 4 (no-l) 2 . 

j=2n -l 

So, 

n 

E ^ Ck 2 ||v9(X ) 2 || 3 a 4 (no - 1) 2 . 

j=2n -l 

For the third term, we have 

n / n \ / n \ 

E E < ^ E i E ™ v 1 E i E & (x ) v (x k )) 1 . 

j=li,k<j \i=l / \k=\ / 

We can see that 

\E( ip (x )< P (x i ))\ < |^(x )|| 3 ||PV(^o)-n^(x )|| p 

< c%(x ) ||JpV -n^|| 

< Ck||v9(Xo)||^|^|| (13) 

and, in the same way, 

|E(p(XoMX fc ))| <c«lb WM fc |b||. (14) 



Alternatively, by Holder inequality, 

\E(fp(X )<p(Xi))\ < ||v?(^o) 2 Hi and |E {<p (X ) <p (X k )) \ < \\<p (X ) 2 ||l (15) 
Thus, by (USD, dD and CE}, 

n no — 1 n 

^|E(^(X )^(^))| < ]T IIV»W a 111 + ^^(^0)11^11^11 

i=l i=l i=no 

n 

< (n - i)y (x f ||! + ckHp (a ) ii, ^ ^- no 

i=no 

< (no-l)||99(Xo) 2 || 1 + C7 5 ||^(X )|| g , 

where C5 = C(c^ i>0 9 l < 00 and 

n 

^ |E (</> (A ) <p (X k )) I < (n - (A ) 2 ||i + C 5 ||v9 (X ) ||,. 
k=i 

Finally, 

n 

£ E (<p (X ) ip (Xi) if (Xi+j) <p (X i+3+k )) 

j=l i,k<j 

< 8Cl\\ip (A ) 4 \U log 3 (|M| + 1) + CfiHv (A ) 2 ||, log 2 (|M| + 1) (16) 

+n (c 2 y (x ) 2 \\ t iog(iMi + 1) + c 5 \\<p (x ) ||,) 2 , 

where C 6 = Ck 2 C 4 C$. 
Third case: j,k < i. 

Again, using three times the operator properties, 
|E ( V (A ) p (X,i) <p (X t+j ) v (X i+j+k )) I 

= |E (if (A ) E (if (Xi) E (X l+j ) E ((,9 (A i+j+fc ) |^ +i ) \ft) |^ )) I 
= |E [ip (A ) [E (A*) E (99 (A i+i ) E fa (X l+j+k ) \F l+j ) \T % ) \T ) 
-E(i P (X i )i P (X i+j ) l p(X i+j+k ))}]\ 

< y (A ) y p* (V (*o) - n (>*v)) TO lip 

^^(Ao)!!^!!^^^)!! (17) 

and 

U^'(>V)ll < IMII|p j (>V) II 

< |M| (||p»- - n^p^ll + |E fa (A ) <p (X k )) 1) 

< |M|(k^>pV|| + |e (v(x ) v (x k ))\) 

< K V +fc ||^|| 3 + C«:||^(Ao)|| (? ^||^|| 2 , (18) 
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where we used inequality (|14p at the last line. 
From (fT7|) and (USD, we derive 

|E (p (X ) p (X) p (X i+j ) p (X l+j+k )) | 

< Ck 3 \\<p (x ) \\ q e i+j+k \\<pf + c 2 k 2 \\<p (x ) || 2 # i+fc ||p|| 2 

<C 7 6 l \\v(X )\\ q M\ 2 (M\ + \\v(Xo)\\ q ) 

where Cj = max{Cfc 3 , C 2 k 2 }. 

With this last inequality and @, the sum §5§ can be bounded in the same way as before. 
We use the integer no to get 

i=l j,k<i 

3no— 3 n 

< ^ * 2 ||p(X ) 4 ||i + C 7 i 2 o l \W{Xv)\\ q \W\? (IMI + \\<p(x )\\ q ) 

i=3no—2 



i=l 



< 27 (n - l) 3 ||p (X ) 4 ||i + C 7 (||p (X ) ||, + ||p (X 



i=3no— 2 



■2ni— 3no 



The sum is bounded by the corresponding series which is finite (majoration by C%{uq — l) 2 , 
where Cs depends only on 0). So, we can conclude the study of the third case by 



J2 £ E & v m p (x i+J ) p (x i+j+k )) 

i=l j,k<i 

<27Cf||p(X ) 4 ||ilog 3 (||p||+l) 

+C 7 C 8 C 2 (||p (Xo) \\ q + ||p (X ) || 2 ) log 2 (||p|| + 1). 



(19) 



To conclude let K be the maximum of all the constants appearing in (jlip . (|16p and ()19() : 



E 



< 4!X 



n[|^(JT ) 4 [lilo^dl^H + 1) 

+n (||p (Xo) 3 II, + ||p (X ) 2 ||, + ||p (Xo) ||, + ||p (X ) || 2 ) log 2 (||p|| + 1) 
+n 2 (||p(Xo) 2 || 1 log(||p|| + l) + ||p(X ) 



□ 



4 Fourth moment inequality for dynamical systems 

In Section [21 we dealt with homogeneous Markov chains through their operators. As usual 
the techniques can be applied to dynamical systems, using transfer operator. Here we state 
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the result for dynamical systems but the proof (which is essentially the same as in Section 3) 
is left to the reader. 

Let (£1, A, [i) be a probability space and T a measurable measure preserving transformation 
(i.e. \/A G A, fi(T~ 1 A) = n(A)). Let us consider the Perron-Probenius operator (or the 
transfer operator) of T, P : L 1 ^) — ► L 1 (/x) defined by 



for all / G L x (/i) and g G L°°(/i). 

As in the Markov case, we assume there exists a Banach space (B, ||.||) of //-measurable 
functions from Q to M which contains 1 and satisfies ([5]) and that P verifies same assumptions: 

(i) there exist k > and < 6 < 1 such that for all / G £>, 



where 11/ = E„ (/) 1. 

(ii) there exists p > 1 such that (i3, ||.||) is continuously included in (L p (/x) , ||.|| p ). 

Again, it corresponds to some quasi-compactness of the Perron-Frobenius operator, see 
Hennion and Herve [11], Baladi [T]. 

Under these assumptions, we have same fourth moment bound: 

Theorem 4. For all f G B such that (/) = 0, / is bounded and mj = max{l, sup x \ f(x)\}, 



5 Applications 

We give some examples where the fourth moment inequality applies and then leads to some 
empirical process invar iance principles. 

Uniform ergodicity. Let (X n ) n >o be a Markov chain on the state space E. Denote by 
(£>°°, ||.||oo) the space of bounded measurable functions from E to M. provided with the uniform 
norm. One says that the Markov chain (X n ) n >o is uniformly ergodic if it is /^-geometrically 
ergodic. This condition is equivalent to the fact that the process satisfies the so-called Doe- 
blin's condition (see Meyn and Tweedie [12]). 

In this situation, if Xq has a distribution function which is enough regular, our fourth 
moment bound (Corollary [2]) implies inequality ([2]). Then tightness follows and empirical 
process invariance principle will follow from the multivariate central limit theorem. Note that 
this result is already known since Billingsley [2]. 

See many examples of uniformly ergodic Markov chains in Meyn and Tweedie [12], like 
T-chains on compact spaces. Another example is given by the Knudsen Gas model (see e.g. 
Pene [13]). 




P n /-n/|| <K0 n \\f\\ 




where — | — = 1. 
p i 
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Expanding maps. For a large class of expanding maps, empirical process invariance prin- 
ciples have already been established in Collet, Martinez and Schmitt [4j and Dedecker and 
Prieur [5] . Expanding maps is an example of dynamical system on an interval. Such transfor- 
mations are studied in Broise [3], as continuous fraction expansion, ^-transformation, Gauss 
map. In many cases, one can show that the Perron- Frobenius operator admits a spectral gap 
on the space BV of bounded variation functions. Since the indicator functions belong to BV, 
Theorem [4] with condition on the initial distribution prove inequality (|2j) . 

Gouezel [10] gave an example of an expanding map of the interval which has a spectral 
gap on the space of Lipschitz functions but not on BV. For Gouezel's example, Theorem [4] 
holds on the space of Lipschitz functions. 

Subshifts. Let E be a finite set and £ = E^ . The metric d defined on £ is 

d(x,y) = 2- in ^°- x ^Vk}. 
Let A = (a(i,j)) i,jeE be a matrix with coefficients in {0, 1} and 

SI = {x G £ : a{xk,Xk+\) = l,Vk > 0}. 

Write T the shift operator on ft, i.e. (Tx)k = x^+i-, VA; > 0. Denote by B the space of 
complex valued functions on O, which are Lipschitz continuous with respect to the metric d. 
The norm on B is |.| = ||.||oo + m (-)> where 

Pfer 11 -'"}- (20) 

Note that (O, d) is compact and then B C L°°. The Ruelle- Perron- Frobenius Theorem shows 
that the transfer operator P has some quasi-compact properties on B. See Parry and Pollicott 
|13j or Hennion and Herve [11]. If 1 is the only eigenvalue of modulus 1 and is simple, then 
conditions (i) and (ii) holds and Theorem [4] is satisfied. If / is a Lipschitz continuous function 
on Q, then by Dehling, Durieu and Volny [6], an empirical process invariance principle is 
satisfied for the process (/ o T l )j>o- 

Linear processes. Let (A, ||.||a) be a separable Banach space. Let (aj)j>o be a sequence 
of linear form on A such that ^i>o l a *l < 00 ' wri ere \a\ = sup{|a(x)|, \\x\\a < 1}- Let (£i)iez 
be an i.i.d. sequence of bounded B- valued random variables, where B is a compact subset of 
A. We define the R- valued linear process 

i>0 

If A is a finite set, linear processes can be view as functionals of subshifts. Here, in the 
general case, we use a slightly different metric. Assume there exists p < 1 and C > such 
that | ai| < Cp l , for all i > 0. We defined on B^ the metric 

d{x,y) = ^p'Wxi - yi\\ A , 

i>0 
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where x = (xi)i> and y = (yi)i>o- Denote by Y k = (. . . ,£_i,£o)- Then (Y k ) k > is a Markov 
chain on £? N and one can shows that (Y k )k>o satisfies ([3]) on the space B of Lipschitz continuous 
functions from £? N to R. Indeed, if / G /3 

|E(/(y fc )|y = y)-E(/(n)|io = x)| = |E(/(..., yo , 6, ••-,&) -/(••• ,so,6,. ..,&))! 

< Cp fc ||y-x|U 

and then ([3]) holds. Hence, (Yfc)fcez is strongly ergodic with respect to the space of Lipschitz 
functions on B N and Theorem [JJ holds. It is clear that f(x) = X^>o a *( Xi ) * s a Lipschitz 
function (on and then fourth moment bound holds for (X k ) k >Q on the space of Lipschitz 
functions (on R). 

Random iterative Lipschitz models. Let G be a semi-group of Lipschitz transformations 
of a metric space (E, d) and let Q be a cr-algebra on G. We assume that the action of G on 
i£ is measurable. 

Let (g n )n>i be an i.i.d. sequence of G-valued random variables with distribution r]. Let 
Xq be a -E- valued random variable independent of (g n )n>l- We consider the Markov chain 
(X n ) n >o defined by 

X n = g n (X n -i) 

with transition operator P definied by 



Pf(x) = / f(9(x))d V (g). 
Jg 

One says r/ is contracting if 

J /" d(g{x),g(y)) \~ 

hmsup^ / dr) (g) : x,y £ E,x ^ y } <1 

[Jg d(x,y) J 

where rj* n denotes the distribution of g n o ■ ■ ■ o gi . 

Assume (E, d) is compact. Let Bq be the space of C-valued Lipschitz continuous functions 
on E provided with the norm ||.||o — ||*||oo ~t~ ^(O? where ui is defined as in (j20p . It is shown 
in Hennion and Herve [TT], Thm.X.3, that if ry is contracting, then there exists a unique P- 
invariant measure on E and (X n ) n >o is /3o-g eome txically ergodic with respect to this measure. 
Then fourth moment bound holds and thanks to Dehling, Durieu and Volny [6], an empirical 
invariance principle follows. One example of application is given by products of invertible 
random matrices (see Hennion and Herve [TT] X.4). 

In the case where (E, d) is not compact but every closed ball in E is compact, one can 
have a similar result but with another Banach space (see Hennion and Herve [TT] Thm.X.4). 
Here, the Banach space is the space B\ of locally Lipschitz functions with weight. These are 
the C-valued functions / such that 

mi / = sup <^ — : x + y \ < oo 

{d(x,y)p{x)p(y) J 

where p(x) = 1 + d(x, xq) for a fixed xq G E. The norm is 

11/1,1 =sup {^ "*!(/)• 
As an example, we can mention a large class of autoregressive models. 
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Autoregressive models. The process (X n ) n >o C R d is called autoregressive with initial 
value Xq E W 1 if it satisfies, for all n > 1, 

X n = AX n ^i + Y n 

where A £ M(R d ) and (Y n ) n >i C M d is an i.i.d. sequence of random variables, independent 
of Xq. See Hennion and Herve [11] Thm.X.16 for conditions under which (X„) ng pj is B\- 
geometrically ergodic. 
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